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ON THE TURING MODEL COMPLEXITY OF INTERIOR 
POINT METHODS FOR SEMIDEFINITE PROGRAMMING 

ETIENNE DE KLERK AND FRANK VALLENTIN 


Abstract. It is known that one can solve semidefinite programs to within 
fixed accuracy in polynomial time using the ellipsoid method (under some 
assumptions). In this paper it is shown that the same holds true when one uses 
the short-step, primal interior point method. The main idea of the proof is to 
employ Diophantine approximation at each iteration to bound the intermediate 
bit-sizes of iterates. 


1. Introduction 

Semidefinite programming is used in several polynomial-time algorithms, like 
the celebrated Goemans-Williamson [3] approximation algorithm for the maximum 
cut problem, the algorithm for computing the stability number of a perfect graph 
0, and many others (see e.g. 0). To give a rigorous proof of the polynomial-time 
complexity of such algorithms, one requires a known theorem, due to Grotschel, 
Lovasz, and Schrijver 0, on the Turing model complexity of solving semidefinite 
programs to fixed precision (under some assumptions). In 0, this theorem is 
proved constructively by using the ellipsoid method of Yudin and Nemirovski [20] 
(inspired by the earlier proof of Khachiyan 0 of the polynomial-time solvability of 
linear programming), but our aim here is to do so by using the theory of interior 
point methods. Perhaps surprisingly, such a proof has not yet been given to the 
best of the authors’ knowledge. 

For example, in Chapter 2 of the recent book [2. it is stated that: 

[...] the ellipsoid method is the only known method that provably 
yields polynomial runtime [for semidefinite programming] in the 
Turing machine model [...] 

The complexity theorem in question may be stated as follows. 

Theorem 1.1 (Grotschel, Lovasz, Schrijver 0). Consider the semidefinite program 
val = inf (C, X) 

(1) X € S n is positive semidefinite , 

(Aj,X) = bj for j = 1 

with rational input C, A \,..., A m , and &i,..., 6 m , and where S n denotes the set of 
n x n symmetric matrices. Denote by 

J- = {X G S n : X is positive semidefinite, (Aj,X) = bj for j = 1,..., m} 
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the set of feasible solutions. Suppose we know a rational point Xq £ F and positive 
rational numbers r, R so that 

X 0 + B(X 0 ,r)CXCXo + B(X 0 ,R), 

where B(X o, r) is the ball of radius r, centered at Xq , in the d-dimensional subspace 

L = {X £ S n : (A jt X) =Oforj = l,.. .,mj. 

For every positive rational number e > 0 one can find in polynomial time a rational 
matrix X* £ T such that 

{C, X*) - val < e, 

where the polynomial is in n, m, log 2 log 2 (l/e), and the bit size of the data X 0 , 
C , ■ • ■, , and b\ ,..., b rn . 

Here (X, Y) = Trace(XY) denotes the trace inner product for symmetric ma¬ 
trices, and hence, when we talk about the ball B(Xq, r) or B(X o, R) we work with 
the associated Frobenius norm 

\\X\\ F = (X,X) 1 / 2 . 

We will show that the analysis by Renegar [12] of the short step interior point al¬ 
gorithm, together with applying Diophantine approximation at every step to ensure 
that the bit size stays small, leads to a proof of Theorem ll.il 

There is also a practical aspect to the results in this paper. Semidefinite pro¬ 
gramming is increasingly used in computer-assisted proofs. Thus new theoretical 
results have been obtained in this way for binary code sizes |14j . crossing numbers 
of graphs pQ, binary sphere packings [15], and other problems. To obtain rigorous 
proofs, it is necessary to give a formal verification of the relevant semidefinite pro¬ 
gramming bound. Usually this is done by computing dual bounds using floating 
point arithmetic, and then showing rigorously that the corresponding dual solutions 
are feasible. This type of “reverse engineering” can be quite cumbersome; see e.g. 
the discussion in [13 Section 5.3]. Moreover, the semidefinite programs involved 
are often numerically ill-conditioned, and it may be difficult or impossible to ob¬ 
tain a near-optimal solution with off-the-shelf solvers; see e.g. [9]. It is therefore of 
practical interest to understand what may be done in polynomial time when using 
exact arithmetic. We note that there already exists an arbitrary precision solver, 
SDPA-GMP (see [19] and the references therein) that uses the GNU multi-precision 
linear algebra library. The algorithmic ideas presented here may potentially be used 
to enhance such a solver to improve its performance, by ensuring that it runs in 
polynomial time, i.e. that the intermediate bit-sizes do not become excessively large. 

Finally, one should note that there have been several papers studying the com¬ 
plexity of interior point methods using finite precision arithmetic (allowing only a 
fixed number of bits for calculations); see e.g. [16, 18] ]6]- For the Turing model 
complexity though, the only results known to us concern interior point methods for 
linear programming; see e.g. the original paper by Karmarkar [7], or the review in 
the book of Wright 1171. 


2. Preliminaries 

In this section we set up the notation for the paper. Since we follow Renegar’s 
proof we mainly use his notation. 
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2.1. SDP problem structure and notation. 

• We will denote matrices (and matrix variables) by capital letters, and gen¬ 
eral vectors (or variables) by lower case letters. 

• By S n we denote the (”'^ 1 ) -dimensional vector space of symmetric matrices 
which is endowed with the trace inner product (X,Y) = Trace(XT). The 
corresponding norm is the Frobenius norm 

n 

\\x\\ F = (x,x) 1 ' 2 = Y,K(x) 2 , 

i= 1 

where Ai(X) is the i-th largest eigenvalue of the symmetric matrix X. By 
5" 0 we denote the closed convex cone of positive semidefinite matrices, and 
iS" 0 is the open cone of positive definite matrices. If the matrix size is clear 
from the context, we will sometimes write X y- 0 (resp. X F 0) instead of 
X e S"o (resp. X e S£ 0 ). 

• The semidefinite program m defines the linear operator A: S n —> K m 
componentwise by 

(. AX)j = ( Aj,X ), with j = 1,...,to. 

Its adjoint operator A* : — y S n is 

m 

A *V = J2 y jAji 

j =i 

where we take the adjoint with respect to the trace inner product. From 
now on we assume that A is surjective. Hence, the adjoint A* is injective, 
and the matrices A ±,..., A m are linearly independent. 

The kernel of A is the linear subspace 

L = kerH = {X £ S n : AX = 0} 

and the matrices A\ ,..., A m form a basis of the orthogonal complement L 1 -. 
The orthogonal projection onto the subspace L is given by 

7r L = I S r.-A*(AA*)- 1 A, 


where Is™ is the identity operator for S n . 

• We may (and will) assume that C £ L, without loss of generality. Indeed, 
every feasible X £ F may be written as X = Xo + AX for some AX £ L , 
so that 

<C,X) = (C, Xo) + (C, AX) 

= (C — tt l (C) + ir L (C), X 0 ) + (tt l (C), AX) 

= (C — n L (C), X 0 ) + (tt l (C), X). 

Thus we may replace C by if necessary. Moreover, the bit-size of 

is bounded by a polynomial in the bit-size of C and H, due to 
Theorem 12.31 below. 
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2.2. Polynomial-time operations. For ease of reference, we will use the frame¬ 
work in the book of Schrijver |13] when discussing complexity. In particular, we 
use the same definition for the bit-size of rational numbers, vectors and matrices 
as in m §2.1], and we will denote bit-size by size(-). In particular, for relatively 
prime p,q € Z, we define the bit-size of the rational number p/q as: 

siz e(p/q) =1+ |"log 2 \p\ + 1 ] + Tlog 2 |g| + 1 ]. 

The bit size of a rational vector (pi/qi,. ■. ,p n /qn) is defined as the sum of the bit 
sizes of its components plus n. Similarly, the bit size of an m x n matrix is defined 
as the sum of the bit sizes of its components plus m x n. 


Diophantine approximation. We will perform a “rounding” procedure at the end 
of each iteration to reduce the bit-size of the iterate, and will use Diophantine 
approximation for this. 


Theorem 2.1 (cf. Corollary 6.2a in 12]). Let a and 0 < e < 1 be given rational 
numbers. Then one may find, in time polynomial in the bit size of a, integers p 
and q such that 

P 6 1 

a -< - and 1 < q < \p\ < f|o:|~| < 7 . 

q q c 

The underlying algorithm is the continued fraction method ; see page 64 in |!3j 
for a description of the algorithm. 

As an immediate corollary, one may approximate a rational vector a £ Q n 
componentwise by a rational vector (pi/qi, ■ . ■ ,p n /Qn) such that 


( 2 ) 




!<%<-, 

e 


\pi\ < n«iii9i, 


in time polynomial in the bit-size of the vector a. 

We restate this result in a form that we will need later. 


Corollary 2.2. Given a rational vector a £ Q n and rational e > 0, one may 
compute in time polynomial in size(a) integers pi,... ,p n and q \,..., q n such that 


(3) 


such that 




< e, 


size(pi/gi,... ,p n /q n ) < n 6 + log 2 



Proof. Assume the integers Pi,qi (i £ {1,..., n}) satisfy ©■ For each i one has 

\pi\ < \\oti\Mi < riMiooki < rNlool-. 

e 


siz e(pi/q z ) = 


< 


< 


1 + [log 2 \pi\ + 1 ] + riog 2 \qi | + 1 ] 

1 


1 + 

5 + log 2 


i„ gJ jmal +1 


6 

m«iiooi 


log 2 - + 1 


Thus 
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As a consequence 



riHooi ^ 


Using ©, A < n, and replacing e by e/n completes the proof. 


□ 


Linear algebra. Each iteration of the short-step interior point algorithm involves 
some linear algebra operations, and we will use the following results to ensure that 
this may be done in polynomial time. 

Theorem 2.3. The following operations on matrices may be performed in polyno¬ 
mial time (in the bit sizes of the matrices and vectors): 

(1) Matrix addition and multiplication; 

(2) Matrix inversion; 

(3) Solving linear systems with Gaussian elimination; 

(4) Computing an orthogonal basis (using Gaussian elimination and Gram- 
Schmidt orthogonalization) of a nullspace {x : Ax = 0} where the rational 
matrix A is given. 

For a proof, see e.g. Theorem 3.3 and Corollary 3.3a in m- 
The last item implies that we may compute an orthogonal basis for L (the 
nullspace of A), so that we may represent any feasible point X £ T as X = 
X 0 + Y* XiBi , say, where the Xi are scalars and the Bfs are suitable symmetric 
matrices of size polynomial in the input size that form an orthogonal basis for L. 
We may also assume without loss of generality that ||i?i||_F < 1 for each i. This is 
important, since we will study perturbations (roundings) of the form X = X + AX, 
where X £ T and AX £ L. Writing AX = Yi =i AxjiJj, one then has HAAUp- < 
|| Arc ||2 - hi other words, we may bound the size of the perturbation in S n in terms 
of the corresponding perturbation in R d . 

2.3. Self-concordant barrier functions. We will use the definition of self-con¬ 
cordant functions due to Renegar [12], that is more suited to our purposes than the 
original definition of Nesterov and Nemirovski nn. In what follows, / is a convex 
functional with open convex domain Df (contained in a finite-dimensional, real 
affine space), and the gradient and Hessian of / at x £ Df will be denoted by g(x) 
and H(x) respectively. Note that the gradient and Hessian depend on the inner 
product we choose for the underlying vector space; see §1.2 and §1.3 in Renegar 
m for more details. 

Definition 2.4 (cf. §2.2.1 in [ 12 ]). Assume f : Df —> R (with Df open and convex) 
is such that H{x) 0 for all x £ Df. Then f is called self-concordant if: 

(1) For all x £ Df one has B x {x , 1) C Df, 

(2) For all y £ B x (x , 1) one has 



where ||v||x := ( v , F[(x)v) 2 is called the intrinsic (or local) norm of v, and B x (x, 1) 
is the unit ball, centered at x, with respect to the intrinsic norm. 
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A self-concordant functional / is called a self-concordant barrier if there is a 
finite value df so that 

fif = sup \\H~ 1 g(x)\\ x , 

xGD f 

that is, the intrinsic norm (at x) of the Newton step n( x) := —H{x)~ 1 g{x) is 
always upper bounded by df . The analytic center of Df is defined as the (unique) 
minimizer of /. (The analytic center exists if and only if Df is bounded.) 

The self-concordant barrier function of the semidefinite program © is 

(4) /(X) = — lndet X with domain Df = Sf 0 D {X £ S n : AX = b}. 

For this barrier function one has 'df < n; see m §2.3.i]. Its gradient (with respect 
to the trace inner product) is 

g(X) = -TTLiX- 1 ), 

and its Hessian is 

H(X)Y = n L (X- 1 YX~ 1 ) with Y e L. 

The local norm for Y £ L at X £ Df is defined as 

\\Y\\ x = {Y,H{X)Y)V\ 

For easy reference, we note that the self-concordance of the function / in (© implies 
that for all X £ Df we have Bx(X,l) Q Df and that for all Y £ B\(X, 1) we 
have 

(5) i- ll y-x|U-<«Hr< T - F L Ti - for all r e r \ {o}, 

where Bx (Y, r) denotes the open ball of radius r centered at Y in the local norm 

II ' Ik- 


2.3.1. Properties of self-concordant functions. We will need the following three 
technical results (and one corollary) on self-concordant functions. 

Theorem 2.5 (Theorem 2.2.3 in [12]). Assume f self-concordant and x £ Df. If 
z minimizes f and z £ B x (x , 1) then 

x + := x — H( y x)~ l g{x) 


satisfies 


la; - z\L < 


\x - z 


1 - a; - z 


A useful, and immediate, corollary is the following. 

Corollary 2.6. Under the assumptions of Theorem \2.5[ one has 

IKaOlU : = Il#(a0 -1 ff(a:)||x < ~ llr 


1 - \\x - z\\ 
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Proof. By definition, 

IN*)IU 


\x + — x\\ 


< \\x — z\\ x + ||^ — X\\ x 

< . ^ ,, -- b ||x — z\\ x Ibv Theorem 12.511 


1 - ||a:- z\\_ 

\\x~z\\ x 
1 - II* — z\\ x ’ 

as required. 

The other two technical results are the following. 


□ 


Theorem 2.7 (Theorem 2.2.4 in [T2]). Assume f self-concordant and x £ Df such 
that ||n(x)|| x < 1. Then 

Mz + )iu+ < (rnrni ^ 

VI - ||n(x)| 

Theorem 2.8 (Theorem 2.2.5 in [T2| ). Assume f self-concordant and x £ Df such 
that ||n(x)|| x < 1/4. Then f has a minimizer z and 

3| Hx)\\l 


2 ~* + * < 


Thus (triangle inequality): 

II* - z\\x < IK*)IU + 


(1 - IK*)IU) 3 ' 

3|K*)|| X 


(i-IK*)IU) 3 ' 


3. The short-step, logarithmic barrier algorithm 


We consider a generalisation of our SDP problem, given by 

val := min (c, x), 
xecl (D f ) 

where c is a given vector, / is a self-concordant barrier with open domain Df , and 
cl (Df) denotes the closure of Df. As before, the gradient and Hessian of / at 
x £ Df are respectively denoted by g(x) and H{x). 

For the SDP problem (JTJ, f(X) = — lndet(X) with domain Df = {X y 0 : 
X £ J 7 }, but Algorithm [j] below is valid for a general self-concordant barrier. 
Define, for given g > 0, 

f v (x) := rj(c,x) + /(*), 

and denote by n v (x) = ~H(x)~ 1 (rjc + <?(*)) the (projected) Newton direction at x 
for f v . 

The analytic curve, parameterized by g > 0, where g is mapped to the unique 
minimizer of f v , is called the central path. 

The complexity of the short step algorithm is described in the following theorem, 
that is originally due to Nesterov and Nemirovski Ill- 


Theorem 3.1 (cf. p. 47 in [12]). The short step algorithm terminates after at most 


k = 


(s£ 
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Algorithm 1 Short step algorithm 


Require: an x\ & Df and 771 > 0 such that 
parameter e > 0 . 
k <— 1 

while — > e do 

Vk 

Set Xk -}-l — Xk T 77 ^ fc (pCk) 

Set = ( x + 7757) w 

k t— A; + 1. 

end while 




(zi)IUi < An accuracy 


iterations. The output is a feasible point Xk such that 

(c, Xk) — val < e. 

Some remarks on the steps in the algorithm. 

• For the SDP problem Jl]), the projected Newton direction is obtained by 
first solving the following linear system: 

(6) My = v 
where 

Mij = Trac e(XA z XAj), ( i,j e (1,..., m}) 

and 

Vi = —bi + 77 Trac e(AiXCX), (tg{l,..., rn}). 

(We drop the subscript k that refers to the iteration number here for con¬ 
venience.) Subsequently, the projected Newton direction is given by 

(7) n v (X) = X(A*y)X + X -rjXCX. 

The matrix M is positive definite (and hence nonsingular) under the as¬ 
sumption that {Ai, ..., A m } are linearly independent. One may bound the 
sizes of M and v in © as follows: 

siz e(Mij) < size(XAi) + size(AjX) 

< 7 i(size(X) + size(-Aj)) + n(size(X) + size(A,)), 

so that 

m 

size(M) < m 2 (l + 2nsize(X)) + 2mn size(Aj). 

i=l 

Similarly, 

m 

size(u) < 77 i + 2mn size(X) + mn size(C) + 2n^^ size(Ai) + size( 6 ) + msize{rf). 

2—1 

As a consequence, the projected Newton direction may be computed in 
time polynomial in the bit sizes of X, 77 and the data A , b and C. Thus one 
may perform a constant number of iterations in polynomial time. We will 
show how to truncate the current iterate X at the end of each iteration, 
using Diophantine approximation, in order to guarantee that the bit-size of 
the iterates remains suitably bounded throughout. 
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• The square root y/^&f that appears in the statement of the algorithm may 
be replaced by any larger number, e.g. |" \/$J] ■ The only change to the 
complexity is that \fdf should then be replaced by the corresponding larger 
value in the statement of Theorem 13.11 

• By construction, each iterate Xk satisfies \\n Vk (xk)\\x k < and after the 
Newton step one therefore has 

(8) l| n 7)fc ( a 'fc+l)IU fe + l S g! 


by Theorem 12.71 As a result, after setting r/k+i = ( 1 + 


8 Jd s 


Vk, one 


again has \\n Vk+1 {xk+i)\\x k+1 < 4; see pj] p- 46] for details. Since we will 
apply rounding (using Diophantine approximation) to the iterates later on, 
we will need to ensure that (0 still holds after rounding Xk+ 1 - 
An issue that needs to be resolved is the initialization question, i.e. finding 
x\ € Df and g i > 0 (of suitable bit size) such that ||n r) 1 (a;i)|| a:i < This 
is addressed in the next section. 


4. Initialization 

Assume now — again in the setting of a general self-concordant barrier / — that 
we only know a rational starting point x' £ Df. We will use a two phase procedure, 
where we first solve an auxiliary problem to obtain a suitable starting point for the 
short step algorithm. The procedure here follows Renegar T2] §2.4]. 

Auxiliary problem. For a given parameter v > 0, we consider the auxiliary 
problem where we minimize: 

fU x ) : = -v{g{x'), x) + f(x). 

Note that x' is on the central path of the auxiliary problem and corresponds to 
u = l. 

Now use the short step algorithm, reducing v at each iteration via 

1,1+1= ( i_ ^r- 

Remarks: 

• The central path of the auxiliary problem passes through x' and converges 
to the analytic center of Df as v | 0. 

• Once v is small enough, we may use the current value of x as a starting 
point for the original short step algorithm. 

• After 

k > lO^ln , 

iterations, we have Vk, < e', by Theorem 13.II 

• In the SDP case of problem 0, one has x' = X 0 and g(x') = —7tl(A 0 1 ), 
that has bit-size polynomial in the input size, by Theorem l2.3l 

• A suitable choice for e' that provides a starting point for the second phase 
depends on the (Minkowski) symmetry of Df around x'. 
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Definition 4.1 (Symmetry of D around x ). Let D be a bounded open convex set 
and x £ D. Let C[x,D) denote the set of lines that pass through x. For any 
i £ C{x,D), let r(£) denote the ratio of the shorter to the longer line segments 
l PI (D \ {a:}). Finally define the symmetry of D around x as 

sym(:r,-D) := inf r(£). 

teC{x,D) 


A suitable value for e' is now given by 


18i?/(l + 1/ sym (x',Dj)) 

At this point one may start the short step algorithm using X\ equal to the last 
iterate produced by solving the auxiliary problem, and 

( 10 ) m = 10 |. w n > -^ f sup (c, x) - val ) . 

12||xr(a^i) c||xi 12 J 

See §2.4 in [12] for more details and proofs. 

The combined complexity of this two-phase procedure is given by the following 
theorem. The proof is easily extracted from the proof of Theorem 2.4.1 in Ell- 

Theorem 4.2 (c/. Theorem 2.4.1 in [15]). Assume f £ SCB and Df bounded. 
Assume a starting point x' £ Df. If 0 < e < 1, then within 

^(^( 1+5ym v, C/) )) 

iterations, all points x computed thereafter satisfy 


(c, x) — val < e sup (c, x) — val . 

\xGD f J 

For the SDP problem dT|) we now assume, as in Theorem 11.11 that we have a 
rational Xq £ J 7 , and that we know rational r > 0 and R > 0 so that Xq + 
B(X o, r)cfClo + B(X o, R). Note that this implies: 

(11) sym(Xo, F) > 


5. An upper bound on the norm of the dual central path 

In this section we give an upper bound on the norm of the dual central path. 
Our analysis is based on a standard argument for the existence and uniqueness of 
the central path; see e.g. m Proof of Theorem 10.2.1], 

Recall that the (primal-dual) central path is the curve rj (X(rj), S(r]),y(r))), 
with 77 > 0 , defined as the unique solution of 

AX = b, A*y + S = C, XS = -I, X >- 0, S >- 0, 

V 

where I denotes the identity matrix. 

Lemma 5.1. Under the assumptions stated in Theorem \l.l\ we have 

(12) IUMIIf < (1 Ax— (<x 0 ,c + 2IICIU7) + F) , 







On the Turing model complexity of interior point methods for semidefinite programs 


11 


where 

n 

||C|| 0 o= max Cij\ 

j=i 

is the maximum row sum norm of C. 

Proof. By assumption Xq is a strictly feasible solution of the primal and without 
loss of generality we may assume that So = C + 2||C'|| 0 o-f is a strictly feasible 
solution of the dual; otherwise we add the constraint 

(i,x) < (i,x 0 ) + V^R 

to the semidefinite program m which is redundant since 

(I, X-X 0 )< ((/, I)(X -X 0 ,X- X 0 )) 1/2 < y/nR. 

Note that So is indeed positive definite, since it is strictly diagonally dominant. 

We may characterize S{r]) as the unique minimizer of the function 

S^(X 0l S) - - bidets' 

V 

over the set {S : S = C — A*y, S >~ 0, y € R m }. 

As in [EH Proof of Theorem 10.2.1], we define the set 

U = \S : S = C - A*y , 5y0,f/eR m , 

(X 0 ,S) - -lndet S< (Xo,So) - -lndet S 0 \. 

rj rj ) 

Clearly, U contains S(rj). 

If a > 0 denotes the smallest eigenvalue of X$, then, for all 5 G U\ 

a(I, S) -lndet S < (Xq, Sq) -lndet So, 

V V 

because a(I,S) < (Xq , S). Now we write the previous inequality in terms of the 
eigenvalues A i(S) of S: 

V < (X 0 ,S 0 ) - -lndet Sq. 

Defining the function 

(j)( A) = cr\— — In A, for A > 0, 

V 

which is convex and has minimizer A* = — with minimum value d>( A*) = - (1 — In — 

(77) * \ / V \ ar l 

one has 

(j) (A i(S)) < {X 0 , S 0 ) — — lndet S 0 — {n — 1)0(A*) for i = 1,..., n. 

V 

By the convexity of <f> and by approximating about the point eA* we have 

</>(A) > 0(eA*) + </>'(eA*)(A - eA*) = (1 - l/e)aA - - In —. 

r] ar] 
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Hence, 


A, (5) < 


1 


< 


< 


(1 - 1 /e)cr 
1 

(1 - 1 / e)a 

1 


(Xo, So) - lndet So — (n — l)d>(A*) H — In — 

r] r] arj 

rj arj z 


(X 0 ,So} + — 

rrj z 


for i = 1 ,..., n, 


(1 — l/e)r 

where the first inequality follows from det So > 1 and In a: < x — 1 , and where the 
second inequality follows because cr > r. 

The last estimate now immediately implies the statement of the lemma: 

y/n 


||S(?7)||f < 


(1 — l/e)r 


(X 0 ,So) + — . 

rrj z 


□ 


Note that the bound on ||S(? 7 )||f depends on the value of rj. It is therefore 
necessary to consider the range of values that r) can take (and v during the first 
phase of the auxiliary problem). During the first phase (auxiliary problem), initially 

v i = l, which is subsequently decreased via Vk+i = ^1 — ^ Vk- It is simple to 

show that during each iteration k of the first phase, 

1 > v k > e', 


where e' is defined in ([9j), which in turn implies 


(13) 


1 - Uk ~ 18n(l + R/r ) ’ 


where we have used JHI) and (fill) . 

Similarly, during each iteration k of the second phase 


1 

12 


( sup ( C , X) — val 

\ X&Df 


<r]k< 




which implies 

(14) \r\\C\\ F < Vk <-, 

6 e 

since B(X 0 ,r) C T and <n. 


6. Rounding the current iterate 

We will round the current iterate X £ T (we again drop the subscript for con¬ 
venience) at the end of each iteration to obtain a feasible X = X + AX , say, 
with suitably bounded bit-size, and where the ’’rounding error” AX £ L satisfies 
11 AX 11X < e for some suitable value e > 0 . 

After the Newton step, but before the update of 77 , we assume that 

||X-X( 7 ? )|| x <c' 
where c' > 0 is a known constant. 
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By the definition of self-concordance: 


ll*-*fa)ll* < 

< 

< 

< 


1 


l-||AX|| x 
1 


|X + AX-X(r,)|| 


x 


1 — e 

1 

1 — e 


\\X + AX-X(r,)\\ x 

\\ x ~ x (v)\\ x + yzi 


l|AX|| 


A' 


d + e 
1 -e‘ 


Thus, if e = A, and c ' = J_ then ||X — X(ry)||x < A. Consequently, by Corollary 
12.61 one has ||n T) (X)|| y < as required (recall (01). 

We may ensure that \\X — X(ri)\\x < ^ during the course of the algorithm by 
taking an extra centering step. Indeed, if we still denote the iterate by X after an 
extra centering step, one has ||n,j(X)||x < 1/64 (by Theorem l2.7D . Consequently, 
by Theorem 12.81 one has 


\\X~X(r,)\\x<\\n v (X)\\ x + 


3KPQI& 

(l-IKPOIk ) 3 



Note that X >- 0 since ||X — X\\x < yg < 1, and the definition of self-concordance 
guarantees that the unit ball in the X-norm centered at X is contained in the 
positive definite cone. 

The task is therefore to find X = X + AX with bounded bit-size and so that 

IIAX||x < A. 

It will be more convenient to bound the X(ry)-norm of AX than the X-norm. 
As a first observation, using the definition of self-concordance, 


\\X-X( V )\\ XM < 
< 


IIX — X(rj)\\x 
1 - l|X(ry) - X||. Y 
\\x-xm x 

1 — 32 

82 

-IIX-X^Hx. 


Invoking the definition of self-concordancy once more, we obtain: 


l|AX||x < 
< 


< 


II AX || x (rj) 

1-||X(t7)-X||x ( j7 ) 
I|AX|| a -(^) 
l-lfllX^-XHx 
II AX||x(t7) 

i _ 32 J_ 

1 31 ‘ 32 


Thus if we show that ||AX||x( ?? ) < 31 ^* 16 then we guarantee that ||AX||x < 
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Note that 


IIAXII^ < (AX,X(r ? )- 1 A XXirj)- 1 ) 
= 7, 2 (AA,5(77)A XS( V )) 

< ^||AA|| 2 ,||5(7 7 )|| 2 ,, 


where the inner product is the Euclidean (trace) inner product, and we have used 
the sub-multiplicativity of the Frobenius norm. 

Recall that ||S'( 77 )||is bounded by (fl2l) fLemma l5.Hl . 

We may now use Diophantine approximation so that 
(15) 

“ AX|1 - £ 3ITT6 ("(TUTT ((V.,-^ W‘) + 2||«(X„-)|k/) + £))“, 

during the first phase of the algorithm, and 

< 16 > "“"^jI7s('(Tlw( (I ' C + 2||CW v)) '■ 


during the second phase, where X' is the last iterate produced by the first phase. 

Due to the upper and lower bounds on v in f[T3jl . (fl5l) will hold if ||AX||f < £i, 
where 


1 

£i 


17 yfn 
(1 — l/e)r 


(A 0 ,-7r L (X- 1 ) + 2||^ L (A ( 


- 1 \ 


ol) 


n(18n(l + R/r)) r “ 


during the first phase, and © will hold if, during the second phase, 


||AX||_f < 


17(y^) 3 

(1 — l/e)re 


(X',C + 2\\C\\ 00 I) 


36 n 


-1 


r 3 ||C||>, 

To obtain a right-hand-side expression in terms of the input data only, we may use 
\\X r — Xo||f < R. Thus we hnd that the last inequality will hold if ||AA'||f < £ 2 , 
where 

1 17(v^) 3 „„ „ _ 36n 


£2 (1 — l/e)re 


( j R+||X 0 ||f)||C + 2||(7|| oo /||f 


r 3 ||C||) 


Setting e = min{ei, £ 2 }, implies that log 2 (4) is bounded by a polynomial in the 
input size. 

Performing Diophantine approximation in the d-dimensional space L yields a 
rational X so that ||AX||f < e and 


(17) size(X) < d ^6 + log 2 ^ ^ , 

by Corollary 12.21 

Thus the size of X is always bounded by a certain polynomial in the input size. 


7. Summary and conclusion 

To summarize, we list the complete procedure in Algorithmic] The main subrou¬ 
tine (used twice) is a short step algorithm with extra centering step and Diophantine 
approximation, shown as Algorithm [2] 

In particular, we have shown the following. 
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Algorithm 2 Short step algorithm with extra centering and Diophantine approx¬ 
imation_ 

Require: 

• Problem data {A, b, c); 

• an ii £ Df and 771 > 0 such that ||?bj 1 ( a: i)IU 1 < j; 

• an accuracy parameter e > 0 ; 

• an update parameter 9 > 0 ; 

k <— 1 

while > (1 — 9)e do 

Set x + = Xk+ n Vk (Xk ) 

Set Xk+i = x + + n Vk (x + ) 

Round Xk +1 using Diophantine approximation, so that size(xfe+i) is bounded 
as in (HU), and \\n Vk {x k +i)\\x k+1 < 5 
Set 77 fc_|_i = 6 -rj k 
k <— k + 1 

end while 


Algorithm 3 Two-phase short step algorithm with Diophantine approximation 

Require: 

• SDP problem data (A, b , c ) and X 0 £ T; 

• an accuracy parameter e > 0; 

• rational R > r > 0 as in Theorem o 

First phase (auxiliary problem): 

Set C 7 T£,(Aq ), Tji 1, X\ Ao, £ ig,j ~(l+R/r) 1 ® ^ g 

Call Algorithm [2] with input (A,b,c,Xi,r]i,£, 8) 

Second phase: 

Set c = C, 771 as in (usd, X\ equal to the last iterate of the first phase, e = e/ 7 ?/, 


Call Algorithm [ 2 ] with input (A,b,c,xi,r]i,£,0) 


Theorem 7.1. Under the assumptions of Theorem \1.11 Algorithm^ computes in 
polynomial time a rational matrix X* £ T such that 


(C, X*) 


val < e 


I max(C, X) — val 


where the polynomial is in n, m, log 2 r, log 2 R, log 2 (l/e), and the bit size of the 
data Xq, C, Ai, ..., A m , and b ±,..., b m . 


The analysis presented here may also be performed for more practical variants 
of the interior point method, such as the long-step (large update) method; see e.g. 
Chapter 2 in [12] . Moreover, since all computations in Algorithm [3] involve linear 
algebra only (Diophantine approximation may also be implemented as such), there 
are definite practical perspectives for implementing Algorithm [3] (or a more prac¬ 
tical variant), using arbitrary precision packages, like the GNU Multiple Precision 
Arithmetic Library (GMP) (https://gmplib.org/), that is already used in the 
solver SDPA-GMP [T9]. 
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